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ABSTRACT 

Evaluating tha af f activanass of caraar guldanca 
programs is a complex procass, and faw comprehensive modals for 
avaluating such programs exist. Evaluation of career guidance 
programs has been hamparad by the myth that program outcomes are 
uniform and monolithic. Findings from studies of attribute treatment 
interactions have ravaalad only a few obvious attributas that appear 
to interact with differential treatments (including such obvious 
variables as gander, ethnic/racial group, and chronological aga). 
miere interactions have been found, they have been complex with 
barely significant effects or are confounded with main affects, which 
makas them difficult to interpret. Substituting parson^oriented 
parameters for attributa treatment interactions changes the 
"inverted*^ pyramid of policy, program, and parson to a "verted" 
pyramid with the parson at the apes, program at the intermediate 
point, and policy at the base or foundation. This person-oriantad 
approach to evaluating caraar guidance programs can be implemented 
through reverse prograsming. The conceptual framework of reverse 
programming encompasses three topics i caraar by objectives, a systams 
approach to caraar counseling, and evaluation models and methods. A 
systems approach to career guidance is possible because of tha quick 
data processing that is attainable by using synchroni^ad computer and 
peripheral technology, (iw) 
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FORiWORD 



Caraef guidanQa pragrams provide Qamprehtniiva, IndlvlduaMitd a^rviees (Interventions) 
syitained over time to all or most students In a sahooL Evaluation of the eMots of these programs Is 
compitx, and few Gomprehenslve modeii for evaluating the ^ffacts of domprehensive oareer 
guidanoe programs exist. Componants that support evaluation inolude aomprehensive statements of 
desired student outoomes, methods of documenting the nature and extant of guldanoe Interventions 
raoeived by individual students^ and arltenla for quality career guidanae programs. This paper reviews 
the status of oaraer guidanoe evaluation and suggests developmental work needed to sypport more 
e^eotlve guldanoe programs. ^ 

The profession Is indebted to Dr. John Critas for his soholafBhIp In preparing this paper. Dr. 
Crltes Is Professor, Sahool of Eduoation and Soolal Poliey, Northwestern Uhlverslty and director of 
the Career Assessment Cllnio. Previously, he was Research Professor. Kent State University. 

The National Center wishes to acknowledge the leadership provided to thr§ effort by Dr. Robert 
f . Taylor, recently retired Executive Director. Dr* Norman dysbei^, Professor of Iducationt 
University of MIssouri-Columbfa; Dr. Edwin A. WhitfleW. Associate Director, Guidance and Testing 
Section, Ohio State Department of Education; Dr. Lawrence Hotchkiss, Research Specialist 2, and 
Judith Sechler, Program Associate, of the National Center for Research In Voationai Education, 
contributed to the deveropment of the paper through their critical reviews of the mgnuscrlpt. Dr. 
Wesley E. Budke, Senior Reseamh Speciarist, coordinated the paper's development, assisted by Ruth 
Gordon and Sandra Kerka, Program Associates, and Laurlan Miguel. Program Assistant Clartne 
Cotton, Jean Messick, and Sally Robinson provided clerical support, and Janet Ray served as word 
processor operator. CIritta Park of the National Center's Editorial Services edited the paper. 



Chester K. Hansen 
Acting Executive Director 
National Center for Research 
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vii 



6 



EXECUTIVl SUMMARY 



ivaluatlon ©f carter guidana@ proRrar?is has reeurred bacauM tha programi mean m mueh to 
so many, both socletally and parsanally. Their effectlveneis Is a arltlcml question on leveral leveli-. 
poMoy datitrminatlQn, projrmm implementation, and pai^onal satisfaction and success. This paper 
cumulatts the collective conolusions of prevloui revlaws and extrapolates from past and pmsant 
theory and research to eMtend beyond the conceptual framework to suggast new modals and 
methods for evaluating career gulda ice programs, especially as they affect and Influence the 
individual student* The focus of the review is on the parson. Fffit is a synoppjs of what other reviews 
have found, concluded, and recommended regarding carMr guidance programi. Next is a critical 
analysis of these perspectives and proposals. PimWy, the author proposes a new orientation toward 
career guidance programs, In which evalyation becomes part of Intervention for each student. 

Evidence from both survey and experimental studies Indloates that the Impact of career guidance 
programs on Individual students is ellhef fnconcluslve or incomplete. However, the encouraging 
summation of data Is that participation In career guidance programs by Individual students 
apparently faoilitates their career matyration. They are more mature in their career choice attitudes 
and competencies (process variables) after « qareer development enpenenca than they were before 
(on as compared to a control group). Ividance from several empirical studies Indicates that 
increased career maturity is related to gi^ater subsequent realism of career choice. The implication 
of these findings is that career guidance that affects career choice pfocaas variables also impacts 
upon career choice aontBnt variables. 

Anaiysis of the perspectives reveals that itiidents are not highly involved In counseling services 
offered. They do not seek out the services. Student Involvement In career guidance activities needs to 
be systematically programmed if students are t© benefit from the services. In addition, the effects of 
career guidance programs are not uniform and monolithic^ Policy statements typically assume the 
uniformity myth, and programs often are designed accofdingly, yet individual students may react 
quite differently to the same career guidance program. Whatever the reason for these differential 
responses to treatment, the implication Is that greater attention to individual difference among 
students needs to be given In both policy statements and program designs. Further^ findings from 
studies of attribute treatment Interactions have revealed few clearly Identifiable attributes that appear 
to Interact with differential treatments, including such obvious variables as gender, ethnfc/racial 
group, and chronological, age. Where interactloni have been found, they are complex with barely 
significant effects or are confounded with main effects, which make them difficult to Interpret. Choice 
of career gyldance treatment becomes custom-made to the individuals what are his or her expected 
outcomes from counseling and how can these best be achieved with this pei^on at this time. 

Substituting PersonH^rlBnXmd parametei^ for a^rlbute treatment Interactions changes the 
'Inverted*' pyramid of policy, program, and person to a "Verted" pyramid with the person at the apex, 
program Intermediate, and policy on the base or foundation. This Peraon^riented approach can be 
Implemented through reveme programming. 

Reverse programming starts with the outcomes of guidance for each person. Using common 
meani to assess the extent to which each person's career objectives have been attained, the 
effectiveness of the Intervention used with an Individual student can be traced to the attributes and 

Ix 



their interaotiQn with the treatment. In addition, these can be aflgregated across students to provEde 
an everall p»regram evaluation* From thes© osllective resulti* policy statements based upon empirical 
criterion evidence can then be stated. 

The conceptuaf framework of revem programming encompaises three topics: career by 
objectives, a syii^ems approach to career counseling, and evaluation models and methods. The 
rationale for si^^^ing career by objectives is likened to the rationale for specifying management by 
objectives. The proc^ure for career by objectives, like management by objectives, Is to deHneate 
what Ihe desired outcomes of a program are and then to work back through each step necessary to 
achieve the objectives. This pfocess not only establishes a criterion for measuring attainment of 
program ©bjectiws, but also eliminates unnecessary steps for goal attainment This elimination of 
unhecessary steps increases the cost effectiveness of management by objectives and costs can be 
objectively defined. Thus. Inherent in management-by-objectlves programs— and similarly career-by- 
objectives programs— are the criteria for evaluating them. Changes In the Implementation plan must 
be consistent with the objectives. Also, If revisions are needed in the objectives, new steps necessaiy 
for attainment must be delineated with the new objectives. 

A systems approach is recommended to Ptrton^riented career counseling with three levels— 
theory, testing, snd technology. Theory represents the distinction between career choice procBss 
and career choice contBrit The process variables (attitudes and competencies) determine the 
readiness of an individual to make a career choice. With sufficient career readiness, an individual can 
make a realistic earner choice, implementing It In job search and placement 

On the testing level of the system, the process and content components of career choice are 
given operational definition by inventories, tests, booklets, and forms used. Through the Career 
Readiness Inventory and Interpretatfon of results with the Cafter D&v&lopwr, career maturity Is 
increased. The student nejct takes aptitude and Interest measures as a basis for career choice 
content* These are Interpreted on the QmrBmr DBaision MakBr, a form that guides the student through 
each step in the career declsion^maklng process. Finally, using the ISuidB for Qccuprntionml 
Exptormtlon, the student translates aptitudes and Interests Into primary and secondary career paths 
projected over the ensuing 5 yeiirs. 

Through synchronized computer and peripheral technology, quick processing of the data and 
the systems approach to career guidance are possible. Using the storage and retrieval capabilities of 
mlcrocomputei^ Is recommended for processing a variety of data on each student to assess goal 
attainment and to aggregate outcomes across students for the evaluation of career guidance 
programs in schools and districts. Although each student's file in the computer can be manipulated 
for any number of relevant statistical analyses, the basic evaluation software can be uniform for any 
situation In which there Is interest In accountability and cost^benefit analysis. Thus, use of the 
microcomputer Is recommended both for career assessment and counseling and for assessing the 
effectiveness of the Parsort^riented approach to career guidance. 

Combining the systems and Pe/son^riented approaches to career guidance in the schools 
provides a new way of prioritizing values and addresses several problems. Several conclusions can 
be drawn. Use of counselor time Is more effective. Career guidance can be offered In addition to the 
usual guidance on college choice and school achievement and students can be Involved in the 
determination of their career development in a variety of Individual and group formats, without 
affecting the Integrity of the Pdrao/i^rlented approach. Also, both teachers and parents can act as 
resource persons for students In Implementing the program. Finally, evaluation of the career 
guidance program, with an objective outcome measure (goal attainment scale score). Is built into the 
service delivery system. It Is possible that the focus of the future for carwr guidance In the schools is 
upon a Perspn^riented approach, implemented through systematic program development and 
inherently consistent with policy statements. 
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INTRODUCTION 



The eentmlity and mWmme of career as a f ulerum of life go unehaljenged in both our folk wisdom 
and profwslonal acumen. Pm^^ (1962) heralded "work and love*' (artmitmn undiimbmn) as the 
halimarNs of maturity, although he fooused almost exclusiraly on love, lut he also reeogniied that 
work Is our "principal oontart with reality," a theme echoed by many neo-Freudians in their 
observations on "work as Integration" and as a major channel for syblimatlon (Hart 194T; Menninger 
1942; pberndorf 1051). Translated mere recently into self-concept terms, this theme is reflected in 
Super's {1i51, p, 8§) proposition that "In choosing an occupation, one is, in effect, choosing a means 
of implementing a self-concept." Projected against the background of lifelong development, with its 
stages and crises, career as a focal point of human functioning, permeated by hopes and fears and 
successes and failures, accrues even more significance, for most of our waking hours are expended 
in either preparing for or engaging in career, iven as a juxtaposition, a counteipoint to nonwork 
time— weekends, holidays, vacations, retli^mant^areer Mterally and figuratively defines by inclusion 
and exclusion the lives we lead and the leisure we enjoy, fxeluding possibly religious faith and family 
ties, career offers the single most comprehensive and pervasive source of self-esteem available to us. 
From TV commercials that proclaim that "A man (sic) is what he does" to career theorists who equate 
identity with work, the assumption is the rame: we are In and of and a part of our careers. 

That problems arifie in making this translation of self Into career (Tledeman and O'Hara 1963). 
however, needs no documentation other than the long history of career (vocational) guidance 
programs established to assist youn^ and old, disabled and disadvantaged, men andlwomen alike to 
make realistic career choices, A dominant societal value, emanating from the American credo and 
Horatio Alger myth, is that each pei^on realize his or her capabilities through equal opportunity for 
their expression, yet due to both endogenous and exogenous factors interacting in and through the 
life space, across the developmental span from birth to death, barriers too often preclude this self- 
career aotualizatlon. Career guidance programs In many settings, but partlculariy In the schools, 
presumably address the problems that arise In the process of career decision making and seek 
solutions to them, Grounded In the Fai^onlan "matching model" of agreement between Individual 
tralts-and-factoi^ and those required by OMUpmtlQm, as exemplined In contemporary theory and 
practice by Holland's ClSSiy RlA^iQ system, but also strongly influenced by, If not committed to. 
developmental career guidance, these programs encompass a wide range interventions and 
outcomes (Campbell et al. 19M), Because they mean so much to so many, not only societally but 
also personally, how effective they are becomes a critical question on severai imBlB^poligy 
determination, program Implementation, and ^/lona/ satisfaction and success. It Is not surprising, 
therefore, that there are periodic and recurrent reviews of career guidance programs to evaluate the 
extent to which they achieve their professed goals or objectives. This is still another review In a long 
series, dating back in recent literature to the mld-19ete and probably originating with Williamson and 
Bordin's (1941) classic paper almost iO yea^ ago. Why? 

If the purpose of this review were only to "review the reviews." then It would Indeed be trivial, 
although, cast into a broader context, there might be considerable virtue in cumulating the collective 
conclusions of previous reviews. To articulate such a conceptual framework, extrapolating from past 
to present theory and researoh, but e^^:f nding beyond It to ahmngB framm, might suggest new models 
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and methods for the evaluation of career guidanee programs, espeeially as they affect and influence 
the Individual student. Mora specifically and pointedly, although this review recogniies the 
importance of policy determination and program implamentation for career guidance, its focus Is 
singularly ^eraon-orianted. The review has three purposes. It begins with (1) a synopsis of what other 
reviews have found, concluded, and recommended regarding career guidance programs, then moves 
to (2) a critical analysis of these pei^pectjves and proposals, and ends with (3) a proposed new 
orientation toward career guidance progrsms, In which evaluation becomes parf of intmnfmntion for 
each and (It Is hoped) every student 
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EVALUATION OF CAREER GUIDANCE PROGRAMS: 
CONCEPTUAL AND EMPIRICAL 



To evaluate aarmr guidanae programi empiriiaany. It Is necessary fii^t to speolfy aonaaptuilly 
what their desired outaomei are. Then, researdh on the extent to which they attain the^ desiderata 
indicate how effective they are. In the discussion that follows. (1) conceptual ^irlteria for the 
evaluation of career guidance programs, which have bMn propoied during thti past half century, are 
summarized and (2) reviews of empirical research applying these criteria In the evaluation of career 
guidance programs during the last two decades are presented and their conclusions are enumerated 
and synthesized. 



Conoaptual Criteria 

What the desired outcDmes of career guidance programs should be are of two kinds«-those 
which generally represent the "establishment" point^f-vlew, and those which question it, even to the 
extreme of proposing that career guidance programs be abolished. What are these pro and con 
positions on the value of career guidance, and what are their implications for evaluating its 
effectiveness? 

Although most reviews of the conceptual heritage of career (vocational) guidance begin with 
Frank Parsons' (1909) monumental contribution of the still viable "matching model" to career 
decision making, it must be understood that career guidance in this countiy has a much broader and 
pervasive history (Srewer 1942) than a point-ln-time event. It is in and of the warp and woof of those 
social evolutionary processes that became one of the dominant value orientations in American 
society around the turn of the century, and that have since served as the rsison d'mtm of the guidance 
movement (Crltes 1981), The fiiBt definition of vocational guidance by the National Vocational 
Guidance Association (NVGA) In 1§37 reflected an admixture of American Individualism and Social 
Darwinism In Its expressed aim "to assist the individual to choose, prepare for, enter upon, and 
progress In an occupation," More recently, to reflect contemporary emphases on the developmental 
processes underlying career choice and adjustment, Super (19S1, p, 92) has proposed this revised 
definition of career guidance: 

It is the process of helping a person to develop and aqcept an integrated and adequate picture of 
himself (sic) and of his role in the world of work, to test this concept against reality, and to 
convert it into a reality, with satisfaction to himself and benefit to society. 

Super's basic concept of developmental career guidance has been translated into and 
operationalized as "Quidelines for a Quality Career Guidance Program" (1979) by the NVdA 
Commission on Criteria for Career Guidance Programs. These guidelines are based upon the 
following conceptual and theoretical assumptions: 

• Development occurs during the llfetrme of an indlvlduaL It can be described in maturatlonil 
terms denoting progression through life stages and the mastery of developmental tasks at 
each stage. Although research evidence Is lacking, It seems unlikely that intervention can 
substantially shorten this maturatlonal process. 
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• Individual d©v©lopm©nt is Influenoed by both heredity and environment. Psychologleali 
seciologicai, eduoatlonal, polltloal, eoonomic, and phyiioaf faetors affect development. 
Appropriate Intervention strategies that foaus on these factoid can Influenoe the quality of 
Individual development 

• pevelopment Is a continuous prosasQ. Individual cJOvelopment can beat be faailitated by 
intervention strategies that b©gin In the early yeari and aontlnue throughout the life of the 
person. Programs that focus only at certain points or at ceilain stages In the rndividuars life 
will have limited effcictlveness. 

« Although development li continuous, certain aspects are dominant at various periods in the 
life span. Programs designed to facilitate career development should account for the dominant 
aspects at given stages. 

• Individual development involves a progress differentiation and Integration of the person's self 
and perceived world. Intervention strategies need to be designed to assist individuals during 
normal maturatlonal stages of career development rather than to provide remedial assistance 
to individuals whose development has been damaged or ratarded. 

• Although common developmental stages can be obsefved and described during childhood 
and adult life, individual differences in progressing through these stages can be expected. 
Intervention prpgrams should provide for these dlfferenceSt maNIng no assumption that 
something is "wrong" with those who progress at atypical rates. 

• Excessive deprivation with respect to any single aspect of human development can retard 
optimal development in other areas. Optimal human development programs are 
comprehensive In nature, not limited to any single facet. It is recognized that those who suffer 
ffom deprivation may require special and Intensive assistance. Where deprivation is long-term, 
short-term intervention Is not likely to be sufficient, 

inherent in these propositions Is not only the essence of what contemporary career guidance Bhould 
bm but also what it might bmaomm given certain revisioni and reformulations based upon critiques 
and evaluations of it. 



Contrary points of view, which have questioned both the usefulness of career guidance and the 
precepts of career development theory upon which It is based, are relatively few, but they have 
served an "honest broker'* funcdon as well as suggesting possible new perspectives on oid Issues 
and problems. Probabiy the most critical was Barry and Wolfs (1962) booh entitled An Epitaph for 
VoGBtionml QuidmmB. They enumerated and defined five "myths" that they saw as outmoded and 
unsubstantiated beliefs that undergirded the conceptual and operational framework of career 
(vocational) guidance in the early liSDs, These were what they called the m^hs of; 

1. The "single'' ttiedry— that only the "matching model" of Paisons (1Wi) triparfte arialyies of 
the Individual, the occupation, and the relationship between them explains career choice, 

2. MMtursment-^that human personality (intelligence, aptitude, achievement. Interests, and 
peraonal characteristics) can be quantified with tes^ and that tests can pradict educational 
and vocational successes. 

3. Cfasilflcatfon systems-^that available methods of classifying occupations (e,g, the Dlotlonmry 
of Oocupmtional Tittms) are useful for students. 
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4, Infsnnatidn— "(1) that formal information is authentic and faetual; (2) that spsetfie 

information about the world of work is valid for and applicable to the future; (3) that such 
infarmatfon meets student needs and produces important learnings; and (4) that such 
information furnishes the basis for reasoned decisions/* (Barry and Wolf 1i62, p, 89) 

i. Realism— that there is actually some erlterlon or entity called ''reality" against which a 
student's career choices can be compared for their practicality and practicability. 

These myths have largely been dispelled (Crites 196S) by the formulation of career development 
theory, construction of career maturity measures, reviilon of occupational clasilflcation systems, 
compilation of more undei^tandable and useful occupational information, and new conceptions of 
choice realism in the yean since Bariy and Wolfs (1M2) book, but several implications they drew 
from the myths still have currency and validity. These implications—*'© holistic approach, a concept 
of personality as dynamic, the Importance of self-concept, an understanding of values; a recognition 
of (Individual) differences, and learning as internalliation" (Barry and Wolf 1962, p. 199)— converge 
upon the main theme of this review: that effective career guidance programs must be 
^©fion-oriented. 

Much In the same tenor, although not as iconoclastic, Qlniberg (1971) expressed many of the 
same criticisms as Barry and Wolf. His "advice to advic^ivers," as he puts It (pp. 288-289), led to 
several recommendations. If there is one general extrapolation that can be made from his 
recommendations, it is that the school counselor must be educated and empowered to deliver career 
guidance to students more effectively. Coupled with the recommendations of Barry and Wolf, it is 
clear that these critics of career guidance are focusing upon the discrepancy between policy 
statements and program objectives, on the one hand, and person services, on the other. The 
principal question, therefore, is: How can this gap be closed? 

On a more theoretical plane than either Barry and Wolf or Ginzberg, Warnath (197S) questioni 
the fundamental assumptions underlying the entire career guidance enterprise. Central to his 
position are propositions such as these: 

• The needs of the individual are subordinated to the goals of the organization. 

• Career development is an abstract construct. It permits vocational theorists to hypothesize 
about factors that appear to affect vocational decision making without regard for the quality of 
jobs in which people eventually find themielves. 

• The vocational theorists have ignored the growing number of writei^ who seriously question 
the myth of the meanlngfulness of work in our industrial society . . , that Is the central issue, 
which vocational theorists and counselors have avoided. The worid of work as they view It no 
longer exists (p. 422, at passim). 

Although written over a decade ago and somewhat overstated, Warnath nevertheless makes a 
telling point: vocational theoiy and career guidance practice are "almost uniformly grounded on the 
proposition that jobs are Intrinsically satisfying." Yet years of research on job satisfaction indicate 
that only at the upper levels of the oocupatlonal hierarchy are the rewards of work intrinsic (Crites 
1969). Warnath comi^ilingly argues that for the vast majority of workers, the basic assumption 
underlying the "matching moder— that satisfaction in work follows from an optimal 'fit"— is Invalid 
for career guidance programs. His proposal, however, that counselors assist clients to "search for 
means other than paid employment through which i^ople can gain meaning from life" (Warnath 
1975, p. 428), appeara implausible. More feasible would be a focus upon what kinds of satisfaction in 
work^lntrinaic, extrinsic, or concomltant--each person can find in making a career choice* 
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Impiileal Reiearoh 



Eviluativs reviews ef carMr guldanee ar© of two klnds^ualitative and quantitative. The fermer. 
sueh as those by Myers (1971), OMver (1S79), Frete (19S1), Holland, Magoon. and Spokane (1981), 
and Campbell et al. (1883), are narrative summaries and Qntiques of the research literature. In 
eont^ast, the latter either report empirioal findings from nationwide surveys and statistioal analyses 
(Campbell 1988: Hotohkisa and Dorsten 198S) or conduot meta-analysei of the cumulated effects 
sizes of "between paradigm" (Critei 1983) studies found in the literature on career guidance 
programs (or, more acourately, alt kinds of vooational interventions) (Spokane and Oliver 1983). Each 
of these reviews is briefly summariied and then oonelusions from all of them are drawn. 



Campbell 

A nationwide questionnaire survey of counsaloi^, students, parents, teachers, and principals in 
353 schools (academic, vocational, and comprehensive In both urban and rural areas), Campbell's 
(1968) study was designed to gather data on the following facets of career guidance programs, with 
the findings indicated: 

• The type of guldanoe servloes taught by studtnts. Students sought educational guidance (66 
percent), personal adjustment counseling (17 percent), and vocational guidance (16 percent), 

• Student Murcet and iMIIiatlon of guldanoe sarvla^. Counselor^ (6i percent) and parents (64 
percent) ranked ahead of teachers (35 percent) and friends (33 percent) as sources of 
assistance; 88 percent reported they knew that vocational guidance was available but only 43 
percent used it! 

• Role of teachers in ttie guidance program^ Twenty-five percent or fewer participated In the 
guidance programs. 

• CounMlor conferences^ Median number of conferences for 4 years vvas 4, each for a median 
time of 16 minutes (as reported by students.) 

• Counselor's time, A median of only 40 percent of a counselor's time was spent in counseling 
with individual students, mostly with reference to college education, not career choice. 

• Pre^ntrance gyldanoe for vooational pf^rams, Twenty^three percent of counseloi^ gave 
"prime direction'' and 63 percent "assisted'' students, but most ranked student interests as the 
criterion for admission, not aptitude scores or school achievement. 

• Um of standardiied tnte. Counseloi^ ranked Intelligence, achievement and aptitude tests as 
most useful to them, but how much they used them was not determined. 

• Adequacy of occupational Information. Only 56 percent of students reported it was "very 
helpfur; 29 percent checked it was "too general"; and the remainder said It did not ansvi^er 
their questions. 

• Student-oounselor ratios. The median ratio was 380 students for each counielor. 
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T© iummarize Campbeirs (1M8) survey flndlngi briefly, counielors spend less than half their time 
with high ratios of students in a l^minute oonferenea on oollege tdueatfon or school aohievement 
once a year with minimal use of standardized tests and negnglble assistanQe from teachers and 
parents. Such a picture of career guidance programs across the country stands in sharp contrast to 
statements of what they should be and what career development theory would suggest they be. 

Myers 

Unlike Campbell (1i6i) who gathered data, Myers (1971) reviewed data gathered by others. He 
organized his review essentially Into two major parts: studies of decision making and studies of role 
functioning. The first was further subdivided to discuss aeauracy of self-knowledge, appropriateness 
of vocational preference, and Instrumental behavior: the second covered general adjustment and 
academic performance at the elementary^secondary and college/university levels. The sum 
substance of this review was less a distillation of verities from the research literature for enhanced 
and enlightened counseling practice than It was a penetrating and often disturbing critique of 
methodology commonly used to study career (and related forms of) oounsellng, whether dyadic or 
group^based. However, there were a few empirically documented procedures worth recommending. 
The most noteworthy contributions of Myers* review were his suggestions for future research and 
practice, a sampling of which include the following: 

• The effects of counseling should be evaluated experimentally. Inquiring into th& relatianBhip 
of &pmgtfie cQuns&/ing prOQBdurmB to spBoifiQ counseling goals, (p. 871; italics added) 

• Cliefits Involved in educational-vocational counseling have characteristic differences that 
deserve careful scrutiny and accurate description . . . clearly, then, the research on counseling 
practice — and, more important, the practice itself— must be planned in the context of where 
the client is in his [sic] growth process, what decision tasks are unique to his age and grade, 
and what treatment goals are appropriate at his stage, (p, 874) 

• To some degree, all the research on Individual counseling suffei^ from the limitations of a set 
of assumptions that can be eKpressed as follows^ 

^ All clients within a given study who seak and/or receive counseling are more or less alike. 

^ All counseling provided within a specified treatment condition of a given study is essentially 
the same thing^ 

— The outcome criteria used in a given study are equally appropriate for all clients treated in a 
similar way. (p. 8SD) 

The Implications of these conclusions lie at the core of a new approach to the Implementation 
and evaluation of career guidance programs as proposed In the next two sections of this monograph. 

Oliver 

Myers* last observation is the principal topic for Ollver^s (197i) review of "Outcome Measurement 
In Career Counseling Research,** but sh^^ also comments on "Design and Analysis,** She largely 
reiterates caveats and criticisms from the nfieasurement and methodological literature, such as 
"Report reliability and validity daia for the Instruments you use" and "Include a control group in the 
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design/* which would be superffuous were it not that, as she points out, research on career 
counseling (and guidance) is replete with measurement and methodologloal flaws and shortcomings. 
These studies are mostly the handful of reports (20 percent) that are accepted for publication, which 
may be as much a commentary on journal editors and their consultants as it is on the researchers 
(and their dissertation advisors?). What Ollver'a review throws into sharp relief is the discrepancy 
between what research on career counselmg and guidance should be and what it is. How can any 
legitimate substantive conclusions be drawn from research so wrought through with the criterion and 
design erroi^ she enumerates. The only encouraging note from her review, which resonates a 
recurrent theme from Krumbota (19Si), Myera (1971). Bergin and Garfield (1971), and othei^, and 
which constitutes a parameter in formulating a Pefton-oriented approach to career guidance, is her 
observation that "perhaps individual criteria should be developed for each client" (Oliver 1979 
p. 2231 



Frete 

This review started where Oliver's left off. Fred's (1981) general conclusion is that— 

Little progress can be made In improving the effectiveness of career intenrentions until more 
specific and systematic evaluative attention is given to (a? the treatment parameters in myriad 
contemporary interventions; (b) the relationship of participant attributes to the effects of 
treatments: and (c) the relationship of both treatment parameteis and participants' attributes in 
the diversity of career-related behaviors, sentiments, and learning that presently serve as 
outcome measures for evaluating career interventions, (p, 77) 

This complex of variables are what Freti and mhmm (e.g., Cronbach and Snow 1977; Garfield 1877) 
call Attribute-by-Treatment Interactions (ATls), which he has enumerated and classified in ixhibit 1, 
Simply stated, the hypothesis is that the outcomes of career aounseling and guidance are a function 
of the interaction (or differential combination) of client attributes and the treatments they receive. 
Fretz (1981) notes that "Crites (1974) has Identifred five major theoretical approaches to career 
counseling: psychodynamic. developmental, trait and factor, behavioral, and client-centered," but 
that, "Of the few studies comparing career interventions, none has selected Interventions specifically 
to represent contrasts of these theoretical domains" (p* 81). Extrapolating from this conclusion and 
the meager (and conflicting) results from a global investigation of ATls, Fretz (1981) closes his review 
with this Implication for future research: 

Small, focused studies can be conducted by many counseioi^ with minimal research support 
and. If conducted In accord with these recommendations (focus on ATls), may contribute as 
importantly, even If not as extensively, as comprehensive, national studies, (p. 85) 

Holland^ Magoon, and Spokana 

In their Annual Review chapter on Counseling Psychology, Holland, Magoon, and Spokane 
(1981) devote a short section on career interventions, which covers the research literature for the 
period 1978-79. Observing that— "the majority of old and new treatments have generated little 
evaluation or research," they conclude from those studies available that 

The Qxperi mental evaluations of counselors, career programs, card sorts, interest inventories, 
workshops, and related treatments imply that the beneficial effects are due to the common 
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SXHIBiT 1 

DIMENSIONS OF CLIENTS, TREATMENTS, AND OUTCOMIS 



Client Tmlment 
mmbuim parameter Outeomes 



Demogfaphic Cohtent domain Career knowladge II skills 

Occupational Acouracy of self-knowledge 

^^^^ information Aeeuraoy of oooupational 

^9® Salf-knowltdge information 

SooloecQnomic/educa- Deolsion skills 

tional lavei Aoouraey of Job-seeking 

Urban/rural origin Sntsrpei^onal eontext skills knowledge 

One-to-one Planning and goal seleatioii 

Psyahologieal aounaellng skills 

IntelligenQe Group counseiing Appropriateness of choices 

Cognitive complexity Self- or computer- (realism) 

Need for achievement administered Range of choices 

Focus of control 

Igo strength Degree of structure Career behavior 

Self-confidence Highly structured Career information seeking 

Anxiety Semistructured Relevant academic 

Dependence Unstructured performance 

Defenslveness Seeking Initial/new job 

Personality type Getting Initlal/new Job 

Job ratings 

Career related ieing promoted 

Type of undecidedness Earnings 
Career maturity 

Attitudes toward choice Sentiments 

Career decision style Attitudes toward choices: 

Motivation for treatment certainty, satisfaction. 

Expectancies for commitment, career 

treatment salience 



Job satisfaction 
Quality of life ratings 
Satisfaction wUh 

Inten^entlon 
Perceived effectiveness 

of intervention 

Effective role functioning 
Self-concept adequacy 
Personal adjustment 
Pei^onal adjustment 
Relapses of career 

problems 
Contributions to community 

SOURCl- Reprinted, by permission of the author, from B.R. Fretz, "Evaluating the Effectiveness 
of Career Inten^entions." Journmi of CounsBling PsyGhQiogy 28, no. 1 (January 1981): 77-90. 
CopLyright 1981 by the American Psychological Assaciation, 
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elements m these divergent tfeatm^nta: (a) exposure t© occupitional information: (b) cegnltlve 
fehearial of VQcatlenal aspirations; (c) aoqulsition of some cognitive structure for organizing 
information about self, oecupatlons, and their relations; and (d) social support or reinforcement 
from counselors or workshop members, (p. 285) 

They do not state what the "common elements'* are, but they do add that "the general failure to find 
different effects for different treatments demonstrates a large hole in our understanding of client- 
treatment interactions and indicates that need for more analytical and less shot-gun evaluation*' 
(Holland, Magoon, and Spokane 1981, pp, 285-286). How similar this conclusion is to those drawn b^^ 
Myers (19T1), Oliver (1979). and Fre^ (1981)--cumulating consensual validation of the need for 
focused research on ATls in assessing the effectiveness of gareer counseling and guidance. 



Spokana and OHvar 

A quantitative review using meta-analysis procedures. Spokane and Oliver's (1983) summary of 
52 vocatlonaj^lnterventlons, in which experimental groups were compared with control groups, 
yielded a cumulated effects size coefficient of .85. Because the sampling distribution for effects sizes 
IS unknown, the significance of this coefficient cannot be determined. However. Spokane and Oliver 
(1983) interpret their finding as follows: 

Our Integrative analysis of 52 investigations of the outcome (sic) of vocational Inten/ention 
confirms the conclusions of previous reviewers that vocational Interventions generally have 
beneficial effects, (p. 124) 

That this conclusion may have to be regarded with caution is suggested by Hotchkiss and Dorsten 
(1986), who point out that "Spokane and Oliver aggregate effects that are not statistically significant 
m the same manner In which they handle those that are significant" (p. 7). What these reviewers 
found, however, generally agrees with previous reviews that have conGluded that ^'almost any 
intervention will have some effects but that they are global and nonanalytical" (Spokane and Oliver 
1933. p. 124). 



Campballp Qonnell, Boyle, and Bhaerman 

Perhaps the most compfehensive review of this entire series is the one Campbell and his 
associates (1983) conducted at the National Center for Research In Vocational Education. The results 
of over 200 Studies were compiled and summarized, leading to these conclusions: 

• The preponderance of evidence suflgests that career guidance interventions achieve their 
Intended objectives if guidance pei^onnel are given the opportunity to provide structured 
guidance interventions in a systematic, developmental sequence. 

• Careef guidance has demonstrated its effectiveness In influencing the career development and 
adjustment ©f Individuals In five broad areas: -^improved school Involvement and 
performance— pei^onal and interpei^onal work skills— preparation for careers— career 
planning skills-career awareness and exploration. 

• Career guidance has been successful In assisting individuals representing a wide range of 
subpopulatlons and settings, such as in correctional institutions, vocational training centers, 
community colleges, and rehabilitation centers. 
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• The number and variety of caretr mterventloni have greatly Increased, giving reaearghen and 
praetUlQners a larger pool of treatmants from which to draw. For example* due to significant 
progress in oomputer applicationi for career exploration and choice, there are several dozen 
models from which to choose. 

The tenor and tone of these conclusions Is very poiitive. If not optimistic, despite the 
measurement and methodological limitations noted by Campbell at al, which are quite similar to 
those enumerated in other reviewi and which are almost contradictory to the conclusions drawn. It 
seems highly improbable that mora than 75 percent of the 200 studies reviewed by Campbell et al. 
were sufficiently sound psychometrically and experimentally to conclude "The prepondemnae of 
evidence suggeats that career guidance interventions achieve their intended objectives" (p. 5i). The 
recommendations for career guidance practice and research made In this revlpw, therefore, must be 
tempered with methodological considerations. These recommendations are Listed in Exhibit 2, where 
It is apparent that they nevertheless substantially agrw with the substance of the other reviews. They 
also converge on the Pefaon-oriented approach to career guidance proposed In this review. 



Hotehkiis and Dmton 

Hotchkiss and Dorsten*s (liSS) report Is both a qualitative review of the literature as weli as a 
quantitative study of career guidance programs. From their "review of reviews," Hotchkiss and 
Dorsten (1985) conclude: 

Summarizing the research on the effects of guidance and counseling utiliiing high school 
students leads to an overall picture of research on guidance interventions as (1) providing 
conflicting conclusions about whether those receiving treatments accrue mora benefits than 
those not receiving treatment, suggesting that these studies indicate what specific aspects of 
guidance and counseling could do rather than what It has done to affect student behavior (Herr 
1982} and {2) confounded by complex Interactions between sen, SES, school and guidance 
program characteristics (e.g., staff and admlnlstrativa support, car^r resource availabfility) as 
well as by type of treatment (group or individual), (p. 7) 

They add to this negative evaluation that "the Impact of career guidance programs requires further 
in^epth examination before firm conclusions regarding the effectiveness of career guidance are 
justified" (Hotchkfsa and Dorsten 19Si, p. 3). 

Using a large-scale data base from a nationwide study. High Sohool mnd Beyond (Jonas et al, 
1983), they proceeded to conduct quantitative analyses of the effects of active career guidance 
programs, using data from two points in time on almost 11, MO students from different regions of the 
Qountry with varied status characteriitioi. and they obtained remarkably consistent negmtlve results. 
They state: 

The conclusion is clear, based upon the data presented here, neither the predictions drawn from 
career guidance goals nor those based on the critiques of schooling and guidance are 
supported. In fact, attending a school that has an active career guidance program does not 
appear to have much affect one way or the other on any of the outcomes studied here. 
(Hotchkiss and Dorsten 19Si, p. 33) 

Such a commentary, based upon broadly representative data and "state-of-the-art" statistical 
analyses, highlights the need for formulating a new model for implementing and evaluating career 
guidance programs. 
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EXHIBIT a 

CAREER GUIDANCE PRACTICE RECOMMENDATIONS 



1. Program* should be dMlgnrt f©p the continuity ©f Individual osretr dtvelopmtnt A major 
disadvantage of eicammlng the outcomes of varioui eareer interventions Is that one often 
overlooks the total oontlnuity of individual eareer development as a person progresses from one 
eareer stage to the next. Typioaily, the studies that have been reported only dial with a piece of 
individual oarwr development (e.g., exploration or decision making). It Is Important that 
programs be designed and evaluated to look at the oontinupus growth of individuals 
developmentally soross stages. Programs should be more oomprehensive In providing this 
developmental process for the individuaK Too often, program developei^ feel they have done 
their job simply by aompleting the initial stages of developing eareer awareness, exploration, and 
deoislon making. Additional assistance should be offered for the oontlnuatlon of this 
development through subsequent stages through such activities as assisting with implementation 
of plans, the selection of education programs, and job placement and adjustment. 

2. More tmphasls sh^ld be placed on txplolting what activities work and on stfengthenlng them to 
achieve opttmum car^r guidance effects^ Too often, program developers Invest their time In 
reinventing the wheel rather than In strengthening what currently exists. Reiources should also 
be expended to strengthen weaker areas of intervention, such as job findings, placemant 
strategies, and vocational adaptation. 

3. Thero Is the need to establish a larger number of highry tralnedt Instttutlonally supported and 
effective teams of guidance worfcei«« Pinson, Gysbem and Drier (liSI) advocate this to assure a 
more comprehensive delivery of guidance sem'ces to all students in all settings. 

4. A comprehensive list of client competenclM shoyld b# developed to provide program direetfon. 
The many studies reviewed in this report identified an impressive array of client objectives to be 
achieved by career guidance programs. Although they were organiied here Into five broad 
themes for reporting purposes, there was no attempt to organize them into a series of sequential 
client competencies that could provide national direction for programs. 

5. School* and ageney*bas#d caraer guidance activities shoyld be mora closely littegrated with 
private sector experienees for cllentt, whenever feasible. A number of studies demonstrated the 
importance of real woHd experience in achieving career guidance objectives; they provided an 
essential element of realism and relevance for the student. 

S. Programs l . ^4ild not rely solely on m few tmditlonal techniques to achieve their program goals. 

Due to the wide ranges of program goals and individuals within a program, programs should be 
expanded to include a variety of interrelated activities that systematically foster career 
development. 

7. Career guidance actMUes that mtm too general or amblgyous should be svofded. Carefully 
planned and highly structured career guidance activities should include (1) clearly stated 
objectives In terms of client outcomes, (2) specific and meaningful client activities to achieve the 
objectives, and (3) a measure of asiessing client achievement of the objectives. 

8. ielf^lnltiated, periodic evaluation of the d^ree to which career guidance programs are achieving 
their objectives should b# conducted more frequentiy. If formal evaluations are not feasible due 
to time constraint, alternative evaluation procedures should be considered Informally, such as 
holding an open forum to assess program status. The latter can be quit© effective in determining 
what works, what dMs not work, and in identifying program impediments. 

i. Counielor education programs should bo competency based In order to Insure that counselors 
a^uire the neeessaiy skills to meet the full range of their cliints' needs. The studies reflected a 
wide latitude of program objectives which require a broader nge of skills than traditionally have 
been provided. 

SOURCi: Campbell et sL (19^), pp. iMO 
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IVALUATION MODILS FOR CAREiR GUiDANCE PROGRAMS^ 

A CRITIQUE 



That ihm nimrmturm on eareer guidance programs, whetr.ar conceptual or empirical, is confusing 
and often contradictory seems apparent. Not only are there opposing viewpoints on the value of 
career guidance programs, but findings of several hundred studies are either flawed by criterion 
and/or methodological shortcomings or they provide scant support for the effectiveness of vocational 
intervehtions. There is some empirical support, howeven for the beneficial outcomes of career 
guidanee programs— they do make at least a minimal positive difference in the career decision 
making and development of young people during the high school years. Why these programs have 
such minimal Impact poses a penetrating question. Some answers, extrapolated from the "review of 
reviews," are proposed In the discussion that follows of (I) the *Mnverted" Policy, Program. Person 
pyramid. (2) the myths and realities of career guidance program implementation, and (3) the need for 
a new framework for Implementing and evaluating career guidance programs. 



Polley, Program, and Pai^on^ The "lfiiv#md" Pyramid 

There is a relationship among (1) Policy statements by leadef^ in the field of career guidance 
and by the professional associations (e.g., NVQA). (g) Program purposes and objectives, and 
{3) Person services and benefits that can be depicted as an "Inverted" pyramid (see figure 1). On the 
top level of the "Inverted** pyramid are Policy statements, which dominate the definitions and 
directions of the career guidance field. Reflecting both the traditional approaches to career guidance 
(i.e., the Parsonian "matching model") as well as contemporary empliases ijpon the developmental 
nature of career decision making, there is no question that the Policy statements have tremendous 
verbal impact on the field as well as funding agencies, despite the criticisms of Barry and Wolf (1962), 
Ginzberg (1971), Warnath (1975), and others. Counselors, teachers, some parents, and a few 
principals pay lip service to these statements of what career guidance Is and how It benefits the 
individual and society, but seldom are the words translated into actions. Too often they remain 
platitudes that are too idealistic, too general, and too Infrequently supported by fact. 

If this indictment of Policy statements seems too severe, then consider the extent to which they 
have been implemented in career guidance programs, the second level of the "Inverted" pyramid. 
Although there is some evidence of the effectiveness of career interventions. It Is inflated by the 
calculation of cumulated effects sizes (Hotchkiss and Doi^ten 1985: Spokane and Oliver 1983) and 
based upon outcome criteria that are suspect at best (Oliver 1979) and that are often only remotely 
related to the objectives of Policy statements. Even when such salient variables as (1) locus of control 
and (2) self-esteem are used as outcome criteria (Hotchkiss and Dorsten 1S85), the results are cleariy 
negative! Criticisms can be made of this study, as they can of most studies, but the weight of the 
empirical evidence Is conti^ry to most of the goals delineated In Policy itatements— with the 
exception of one outcome variable. A tabulation of the outcome criteria reviewed by Spokane and 
Oliver (1983, pp. 110-117) reveari that the most numerous and largest cumulative effects sizes are 
yielded by measures of career maturity (Career Maturity Inventory, Career Development Inventory. 
Assessment of Career Decision Making). It is noteworthy that mi! of these inventories measure what 
Crites (1978) terms csmr ahoicm proQesa, not QBreBf QholoB cQntmnt Not only have indices of the 
latter lacked psychometric reliability and validity (Myei^ 1971: Oliver 1979), but when they have had 
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icceptabia meaiuremant properties, they have not shown appreciable effeeti of career guidanca 
programs. In other wordi. career guidance programs appear to have their most significant effect 
upon the procesa variables (career choice attitudes and competencies) m career development, as 
compared with the content variables (i.e., realism of career choice). No wonder, then, that there Is a 
discrepancy between Policy statements, which cover a broad spectrum of eontwnt outcomes (from 
classroom achievement to pe^onallty changes), and Program effects, which seem to be centered 
largely upon career choice proaeBB. 

At the bottom of the "Inverted" pyramid is the Person In the overall schema of career guidance 
programs. One of the directives of this review was to evaluate the effects of career guidance 
programs on 'Individual students." Whatever evidence there is. whether survey or experimental, 
indicates that the Impact of career guidance programs on individual students is either inconclusive or 
incomplete. In effect, we do not know what difference career guidance programs make on individual 
students. The only encoumging summation of data is thai participation In career guidance programs 
by individual students apparently facilitates their career maturation. More specifically, this means that 
they are more mature In their career choice attitudes and competencies after an interventive career 
development experience than they were before (or. as compared to a control group). Because there 
is evidence from several empirical studies that Increased career maturity is related to greater 
subsequent realism of career choice, however poorly defined and measured, the impHcation of these 
findings is that career guidance that affects career development process variables also has a 
significant effect upon career choice content variables. Given a sufficient threshold of career 
maturity, there Is a greater likelihood of career realism. It is at this Person level in the "Inverted" 
pyramid that the Policy statements about career develppment can be translated through Program 
commitments to have a meaningful effect upon the Person, who should be the focal point of the 
entire system. 



Myths and Realities of Career Guidanoa Programs 

There are several myths that surround the activities of career guidance programs In the schools. 
Not the least of these involves the counselor, who. according to Policy statements and Program 
imperatives, is the key person in organliing, directing, and offering career guidance services. In 
actuality, however, as national surveys such as Campbeirs (1168) indlcate.there are several 
constraints on counselors that severely circumscribe their Impact as service providers. Not only do 
student/counselor ratios far exceed what ts considered ideal, but counseloi^ often spend more time 
In noncounseling activities than in career guidance. Moreover, their focus is usually more on college 
choice and school achievement than career development. But even If they had sufficient time and 
adequate budgets and materials, it is clear that the assumption that students will avail themselves of 
career guidance Is largely a m^h. Contrary to expectations, students are not highly involved in the 
services counselors offer, when and If they offer them. It Is all the more remarkable, then, that career 
guidance programs have the positive effect they do. Perhaps it is exactly because evaluations of 
career guidance programs have Involved students in them that the effects have been found. The 
implication is that student Involvement in career guidance activities needs to be s^tematlcally 
programmed if they are to benefit from the services. 

Still another myth, which has long been recognized In critiques of psychotherapy (Klesler 1971), 
Is that the effects of career guidance programs are uniform and monolithic. Policy statements 
typically assume the uniformity myth, and Programs are often designed accordingly, yet individual 
students may react quite differently to the same carmr guidance program, what has been termed the 
fan effBat (Crites 1981). Some clients may make positive gains as a result of the guidance services, 
some may make no gains, and some may experience negative gains. That Is, they score lower on the 
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posttegt autcome criteria than they did on pretests. Why this phenomenon oeours is not known at 
preient, although some hypotheaes based upon ATls (Freti 1981) have bmn propoiad. Whatever the 
raaaon for these difterential responsei to treatment, the implication is that greater attention to 
individual diffarencas among studenti needs to be given in both Policy statements and Program 
dasigns. 

That analysis of ATls may provide an answer to the fan ef/ecf appears a promising approach. 
Not only does It make allowance for individual differences in attributes that interact with soma 
traatment paramaters and not othei^, but It presumably offers the posilbility of empirieally 
establishing which ATls are most effectiva before Intarvention and thus constituting a basis for 
diagnosis and prognosis (Cntes 1981). Studias of ATls, however, have been less than encouraging in 
thair findings (Hotchkiss and Doi^ten 1985). There are few cleariy identifiable Attributas that appear 
to Intaraat with differential Treatments, including such obvious variables as gander, ethnic/racial 
group, and chi^nologlcal age. Whara Interactions have been found, they are complax with barely 
significant effects (not robust) or ana confounded with main effects, which makes them difficult to 
interpret Perhaps ATls are also a myth, partlculariy when carried to their extreme logic each client 
becomes sui gmnmris (a class or category par m). Choice of traatment (career guidance) then 
becomes custom-made to the individual: what are his or her expected outcomes from counseling and 
how can these bast be achieved with this pei^on at this point-ln-time? Thus, Perso/i-orientad 
parameters are substituted for ATls based upon frequently quastlonable group data. 



The **Vert#d*' Polteys Pregram, and Person ^ramid 

If the realities instead of the m^hs of career guidance are considered, then the "Inverted" 
pyramid of policy, program, and pei^on should be "Vartad," that is, person should be at the apex, 
program Intermediate, and policy on the base or foundation (figure 2). A ^efson-oriented program 
grounded in circumspect Policy statements is then thrown Into clear relief. The ravlsad schema is not 
only more conceptually consistant, but it batter reflects what is known empirically about the 
affaotiveness of career guidance. It also puts the focus upon the individual student where it ultimately 
should be. The question that remains is: How can the Person-oriented approach be implemantad 
within the complex of policy statements and program guidelines? 
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EVALUATION METHODS AND MICROCOMPUTERS FOR CAREER 
QUIDANCEi A >£/ISOAr.ORIENTED APPROACH 



impllalt In this question, and in the "Varted** pyramid^ Is m appraach to Perten-orienttd career 
guidance, based upon the principle of rei^e/^t programming. Rather than formulating broad policy 
itataments, which at best are only minimally implemented through program, reveraa programming 
starts with the outcomes of guidance for mmgh perion. Using a common metric to assess the extent to 
which each person's career objectives have been attained (Cytrynbaum et al, 1979: Krumboltz 19S6), 
not only can the effectiveness of the Intervention used with an Individuaf student be traced back t© 
his or her Attributes and their Interaction with the Treatment (ATI), but these can be aggregated 
across students to provide an overall Program evaluation. From these collective results. Policy 
statements based upon empirical criterion evidence can then be stated. Haw this conceptual 
framework of reverse prDgrammlng can be used is the subject of this last section in the review, it 
covers the following topics: (1) career-by-objectlves, (2) a systems approach to career counseling, 
and (3) evaluation models and methods. 



Caraef-by-ObJtetlves 

The analogue for career^by-objectives (CBOs) is the well-established practice In business and 
industry of management^by^bjectives (MSOs). Following reverse programming principles and 
procedures, the rationale for specifying MBOs Is first to delineate what the desired outcomes of a 
program are and then to "woric back" through each step that Is necessary to achieve the objectives. 
Not only does this process establish an accountability criterion for the programt that is, the extent to 
which the objectives are attained (usually expressed in percentages), but It also eliminates through 
reverse programming unnecessary steps for goat attainment. Because goaNrrelevant steps are 
eliminated, the cost effectiveness of MBO programs is appreclabty greater than more global 
approaches that are lass specific and directed. Costs can be objectively defined by amount of time 
invested in the program as compared with othen, the resources expended ("dollai^ and cents"), the 
number of personnel needed to achieve the objectives, and so on, all of which can be factored In as 
parameters for a cost^benefit analysis. Thus, inherent in MBO programs are the criteria for evaluating 
them, the parallel for assessing the effectiveness of career guidance programs being obvious. 

The concept of CBOs is new and needs to be articulated further to Indicate how It Is at the core 
of a Paraon*oriented approaeh to career guidance. Following the rationale for MBO programs, the 
first step would be: What outcome(s) does this student want from his/her contacts with the career 
guidance counselor? Answers to this question may range from choice among career options to how 
a course of study relates to particular careeiB, Or, as Is so often true of undecided students, the 
objective is to decide upon an objective. The counselor and client work collaboratively on 
formuliiting CBOs that can be achieved within a given time frame, which is frequently a central 
consideration In carMr guidance because clients typically want to make a decision "right now." This 
sense of urgency (or what Crites [1988b] has termed the /mmed/acy ImpmrmtivB) must be built Into 
the second step In CBO car^r counseling, which is to specify what has to be dene to accomplish an 
objective, beginning with the next to last behavior or activity and reverse programming to the 
beginning of the car^r counseling process. Each of these behavioral acts by the client and/or 
counselor Is then listed in the agreed-upon sequence to constitute the career counseling plan. If 
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contingencies srii# In fmplementing the plan that ealli for revising It. then ippropriite ehangei are 
made, but they must be Qonslstent with the abjectivas. Also, If it becomes apparent during the 
gounseling process that the objectives need reviiion, then new CBOs are delineated, along with steps 
neoeisary to attain them. Thus, this approach to a Ferson-oriented career guidance inoorporates 
fleKibility while It achieves specificity. 

To illustrate how reverse programming was used with an actual client, CQnalder the case ©f 
Randy, a high school senior who came for career counseling because he was undecided. During the 
first Interview, it became apparent that his primary CIO was to make a career choice, but that he had 
no idea of how to accomplish this objective, never having made a major life decision before. The 
counselor explained that before he could make a career choice he needed to relate his aptitudes and 
interests to those required by different occupations and Identify those that ware most realistic for 
him. To do this. Randy flmt needed to have information about himself and,the woHd of work. The 
counselor pointed out, however, that to use this Information In translating his self-concept Into a 
compatible occupational role, he had to be career^reatfy or mature enough to mskm a decision. 
Because Ha came for caraer counseling due to his Indecision, it seemed important to assess his 
career readiness (career maturity). Therefore, Randy and the counselor agreed on the following 
sequence of steps in the career counseling plan: 

• last step: declare a career choice (CBO) 

• fourth step: gather occupational information 

• third step: take aptitude tests and Interest inventory 

• second step: increase career readiness 

• first step: assess career readiness 

Reversing these steps, the counseling began with Randy taking the Career Readiness Inventory 
(CRI) and progressing through the the remaining steps to his CBO. 

A Systems Approaeh to P#^an-artentod Cara#r Counsaling 

This highly abbreviated summary of the career counseling for Randy reflects a general 
schematic for career counseling based upon the systems approach shown In figure 3. There are three 
levels in the system, the topmost being Theory, which represents the distinction made previously 
between career choice pfocess and career choice confenf (Crites 1978). To the left are the process 
variables attitudes and QQmpmtBnQioB that detemiine the readiness of an Individual to make a career 
choice. Analogous to the concept of reading readiness, career readiness is a a/ne quM non for career 
decision making. If a student Is sufficiently career ready (has mature attitudes and competencies), 
then he or she can make a realistic career choice, based upon aptitudes, interests, and opportunities, 
as depicted on the right side of figure 3, This progressive 'tunneling" of career options, through what 
Tyler (1961) calls the "exclusion proceis," culminates In a career choice— and Its Implementation in 
job search and placement. 

On the Testing level of the s^tem, the process and content components of career cholue are 
given operational definition by Inventories, tests, booklets, and forms that are used in the Person^ 
oriented (CBO) approach to career guidance. The Career Readiness Inventory (CRI) (Crites liasb), 
a second generation reviilon of the Career Maturity Inventory (CMI) (Crites 1t78), measures the 
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degree ©f earetr development of the studenfi ehoiee ittitudes and competencies. The CRI can be 
either hand or msehfne loored and the reeulti interpreted with the Career Deveioper (Crites 198Sa), 
whioh also "teaQhes the teat," so that by explaining the oareer^ready responsea to the CRI oareer 
maturity ia aignlflcantly increaaed (Crltea liSSo), Given a sufficient threihold of career readiness, the 
student next takea aptitude and Interest measurea aa a basis for career choige aorimnt These are 
reported and Interpreted on the Carmer OeGi&ion Mmker (CDM) (Crites 19M), a form baaed upon 
instruetlonal design principles, which takes the student through each step In the career decision- 
making process. Finally, using the Guide for OGQUprntional Expiormtion (GOi) (U.S. Department of 
Labor 1984), the atudent translates aptitudea and interests into primary and secondary career paths 
projected over the next i yeai^, with the help of the Career Pmth Finder (Crites ISSia). Theae career 
paths, including relevant intermediate education and/or training, constitute the student's CBOs. 

The date upon which they are based is processed in the system on a third level (not shown In 
figure 3), which la Technology, If It were not for the recent developments in aynchronfied computer 
and peripheral technology, the syatems approach to career guidance would not be possible. 
However, there are now available three components that make the system a reality and that have 
made possible ita field teiting during the past S yeare. The fIrBt component ia a National CQmputer 
System (NCS) Sentry 3000 Scanner, through which aptitude and intereat answer sheets can be 
processed and scored by the computer In a matter of seconds. The second component, a personal 
computer (e.g., IBM PC/XT), not only acores the aptitude testa and Intereat inventories, but also, 
through a specially developed aoftware program (Crites 198S), compares the student to all 12,000 
occupations in the economy and prints out the realistic career options on the CDM in leas than a 
minute! Thus, the Technology accomplishes in a fraction of the time the profile or psychograph 
(Crites 1969) comparisons that took counselors, uaing Inspectional/subjective techniques, many 
hours to complete. 

Evaluation Models anc^ Msthods ^ 

Ualng the storage and retrieval capabilities of the microcomputer, a variety of data on each 
student can be processed to asaeaa goal attainment (career counseling success) and to aggregate 
outcomes acroaa atudents for the evaluation of career guidance programa in achoola and districts. 
Primary data for such analyses are (1) the goal attainment acaie score, (2) client attributea 
(demographic and/or paychometric), and (3) type of "treatment" or approach used in the career 
counaeling. Other significant parametere that can be factored are (1) number of client contacts, 
(2) length of each contact, (3) counaelor/cllent gender, (4) Individual and/or group guidance, and so 
forth. All data can be entered into the microcomputer either on scannable forma or by manual key 
entry by the counaelor or a clerk. A *1lle" is created In the computer for each student that can be 
manipulated for any number of relevant atatiatlcal analyses. These will ymry, of course, from one 
program to another, but the basic evaluation aoftware can be uniform for any aituatlon in which there 
is an intereat In accountability and cost^benefit analyala. Deacriptive stattstica on program activities 
for administrative purposes can also be eaaily generated ae can cumulative career records. Thua, the 
systems approach to Persort^hmnimd career guidance can serve many purposea. 

There Is no reason why the counaelor cannot alao play the role of researcher in the syatems 
approach. "Uaer^friendiy" statistical packages can be created that assist the counselor having no 
statistical background or training In conducting rather sophisticated statistical analyses that yield 
career guidance program evaluations. Among these statistical techniques are c^^ntemporary analyses 
of slngle^subject data (Foster 1982) and time-series observations (Cook and Campbell 1979), as well 
as traditional between and within paradigm methods (Crites 1983). Using a "stat^pack" menu, for 
example, a counselor can select the type of analysis desired, and a canned "stat^pack" selects 
appropriate data from student files, conducts the analyses, and prints out the results, which can be 
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phraied vtrbally In a narrative fer easeload accountability or program evaluation purposes. In short, 
the miarocomputer can be used not only for career asiesament and counseling, but also for 
asiessing the effectiveness of the Paraon^riented approach to career guidance. 

Although this approach focuses upon the Individual, it can also be used in a group format to 
broaden the service deliver base. There are two ways In which this can be done, given that the 
career assessment component (CRI, Career Developer, CDM, and CPF) is part of the program. One 
group format Is what traditionally has been called "group guidance," In which S-10 students meet 
with a career counselor. A general orientation can be given to the career assessment materials and 
group members can either use the largely self^interpretattve forms on their own or pair up with 
someone else, with the counselor providing assistance as needed. Another group format is to present 
a career development course, such as that prepared by Savlckas and Orites (19^) which involves the 
classroom teacher In the career guidance course. This course has easy-to-follow lesson plans, 
exercises for students, overhead transparencies, and test materials, all keyed to career assessment 
and career decision skills. The course can also be programmed for the Burroughs ICON computer, 
which has a terminal for each student In the classroom but which allows interaction among students 
and with the teacher. Moreover, it offers the exciting possibility of involving parents with the students, 
in a series of "career nights," during which they work collaboratively at the terminals to explore 
career options. 
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SUMMARY 



CDmbming the lystams and ^efMn-ariented approaches to career guidance fn the lohools not 
only provides a new way of priontiiing values {the "Verted" pyramid) but also addresses several 
reality problems identified in previous reviews. Fii^t. use of counselor time Is more effective, even if 
the time spent by counselor is no more than it has bean In the past. Second, career guidance can be 
offered in addition to the usual guidance on college choice and school achievement. Third, students 
can be involved in the determination of their career development in a variety of individual and group 
formats, without affecting the integrity of the Person-oriented appi^ach. Fourth, both teachers and 
parents can act as resource pe^ons for students in implementing the program. Fifth, evaluation of 
the career guidance program, with an objective outcome measure (goal attainment scale score), is 
"built into" the service delivery system. It is entirely possible that the focus of the future for career 
guidance in th# schools Is upon a Person-oriented approach, implemented through systematic 
Program development and inherently consistent with Poliey statements. 
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